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ABSTRACT 

This research was conducted to discover school 
administrators’ methods of searching for and processing information 
needed in decisionmaking, and to determine whether this decision is 
affected by cost and risk factors in the decision situation. A 
teacher selection process was simulated, with two independent 
variables (the cost of information available and the risk involved) , 
and five dependent variables (average time required to process 
applicants, information selectivity, proportion of available 
information used, specificity of search pattern, and measures on both 
tentative and final certainty) . The subjects were 81 elementary 
principals selected randomly from a three-county area in Washington 
state. They were required to consider five applicants for a 
fictitious teaching position and to make decisions regarding the 
suitability of each. An analysis of variance yielded cost as a 
significant main effect. Risk was not significant, and there was no 
significant interaction. The technique developed for analyzing 
information search processes utilizing a computer-based information 
system holds considerable promise for use in the selection 
decisionmaking process. (MBM) 
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PREPACE 



The research described in this report developed from 
the author 1 s involvement for two years as a Research Associ- 
ate on an earlier research project.* The earlier project 
was a pioneering effort in the study of the complexities of 
the selection decision process. 

From countless hours of involvement in all phases of 
that project the germ of the hypotheses for the present 
study evolved. The indebtedness to the earlier study goes 
beyond the fostering of a research hypothesis. Original . 
materials developed for that study were adapted for use in 
this study and the methodology was developed based on con- 
siderable technical knowledge gained in the earlier effort. 

But above all, acknowledgment must be given to Dale L. 
Bolton, the Project Director of the original teacher selec- 
tion study. The skills he imparted, the ideas jointly de- • 
veloped, and the constructive criticism — these all forged 
and tempered the final product which follows. 



*Dale L. Bolton, Variables A ffecting Decision M aking 
in the Selection of Teachers, United States Office o^Edu- 
cation, Bureau of Research, Final Report, Project No. 6- 
1349, August, 1968. 



CHAPTER I . SUMMARY 



The following is a brief description of the problem 
investigated, its scope, the objectives of the study, the 
methodology, the results of the experiment, and the implica- 
tions of this project. Some recommendations for practice 
and research are also projected. 

The Problem and Its Scope 

This research was conducted to examine the predeci- 
sional information search and processing behavior of school 
administrators and to determine whether this behavior is 
affected by cost and risk factors in the decision situation. 
This was accomplished by simulating a typical educational 
decision making situation, namely, the teacher selection 
process. The general purposes of this study were: 

1. To examine the effects of two variables, (a) cost 
of information, and (b) risk involved in the deci- 
sion, on the information search behavior of deci- 
sion makers in a simulated teacher selection situa- 
tion. 

2. To categorize these behaviors into generalized 
strategies for purposes of prediction and analysis 
of selection decision making. 

To accomplish these two objectives, it was necessary 
to develop some means of measuring the behavior of admini- 
strators while it was taking place, while still controlling 
and manipulating certain elements in the situation. To 
accomplish this, an adjunct purpose of this study was the 
development of the simulated situation within which the 
administrative decision making process was studied. 

The two independent variables in the experiment were: 

(a) the cost of information available to the decision maker, 
and (b) the risk involved in the decision. The five depen- 
dent, or criterion, variables were: (a) average time re- 

quired to process applicants, (b) information selectivity, 

(c) proportion of available information used, (d) speci- 
ficity of search pattern, and (e) measures on both tentative 
and final certainty. These variables are summarized in 
Table 1.1. 

There is dual significance to the problem examined in 
this study and this significance relates to the focus on 
predecisional processes rather than on the decision itself 
to the significance of the problem examined, namely, the 
selection of teachers. 
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Table 1.1 

Variables in the Study- 



Independent Variables 



Dependent Variables 



1 . Cost of Information 

a. High 

b . Medium 

c . Low 



2. Information Selectivity 

3. Proportion of Available 

Information Used 



1. Average Time per Appli 
cant 



2. Risk Involved in Decision 

a . High 

b. Low 

c. Variable 



4. Specificity of Search 
Pattern 



5. Certainty 



a. Tentative 

b. Final 



Research in the area of decision making has tradi- 
tionally focused upon the strategy of the decision and has 
assumed the information base of the decision maker. How- 
ever, in view of the fact that the information the decision 
maker has describes the environment, acquaints him with al- 
ternatives, and may even suggest probabilities of outcomes, 
this information base .is certainly one of the key determi- 
nants of decision quality. 

The significance of examining the teacher selection 
process lies in the fact that each teacher hired represents 
a potential gain or loss for the district in terms of goal 
accomplishment. Considering the large number of teachers 
hired each year, the quality of the selection process be- 
comes a major concern. The specific significance of this 
study lies in the fact that decisions are based upon infor- 
mation and therefore the process by which that information 
is obtained — and the variables affecting that process — may 
relate significantly to the quality of selection decisions 
which ensue. 

Of the dependent variables in the study, time required 
to consider an applicant has strong practical ramifications. 
Time, especially administrative time, is expensive and the 
saving of even a small amount on each of many selection de- 
cisions would represent substantial savings for a school 



Information selectivity refers to the proclivity of the 
decision maker to favor certain types of information and 
disregard others. If a pattern for this preference exists. 



system. 



more emphasis might be placed upon providing this type of 
information and eliminating more pertinent information from 
consideration . 

The p roportion of available information used is a mat- 
ter of concern because of the vo lumi nous natur e of informa- 
tion — much of it redundant— available in the selection 
process. This poses two distinct problems for the decision 
maker : 

1. The time required to consider all of the informa- 
tion is costly, 

2. The deluge of information available might result 
in information overload (either physical or psy- 
chological) and subsequent impairment of the deci- 
sion maker's ability to enter the information 
accurately into his decision process. 

Specificity of search pattern refers to the manner in 
which an individual chooses items of information to consid- 
er and has implications for both information format and 
efficiency of handling. For example, if certain types of 
information are selected for first consideration, then the 
placement of these items in close proximity and at an early 
point in the information document would facilitate informa- 
tion gathering. 

Certainty regarding the "correctness" of the decisions 
made is a desirable factor in a decision maker. This asser- 
tion is based on the assumption that indecisiveness leads to 
uncertainty and vacillation which can substantially inhibit 
the quality of subsequent decisions. 

The significance of these five dependent variables lies 
in their relationship to potential tangible gains in the 
quality of the decision making process and, ultimately, for 
a school system as it applies that process to a myriad of 
teacher selection decisions. The rour dependent variables 
exclusive of certainty were postulated to be principal com- 
ponents of a decision maker's strategy for searching for and 
utilizing information in making selection decisions. 

The certainty criterion was included in the study as 
one dimension of a criterion of decision quality and as a 
practical consideration for the reasons outlined above. 
However, it should be clearly understood that decision qual- 
ity as such was not a direct concern of this study and any 
attempt to generalize the results to qualitative statements 
about the decision process would be spurious. 

The independent variables were selected for examination 
because of their ubiquitous nature in every decision 
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situation. Both cost and risk operate as external con- 
straints on the decision maker and as such are more gener- 
ally applicable to any decision situation while internal or 
psychological constraints are not. 

Objectives 

The general hypothesis of the study was that informa- 
tion cost and the risk involved in a decision affect the 
information search and processing behavior of the decision 
maker, that is, they affect the information search strategy 
of the decision maker. The primary objective was to ascer- 
tain whether certain general patterns of variability could 
be discerned and classified. To accomplish this, specific 
hypotheses regarding main and interaction effects for the 
two independent variables were tested for each of the five 
dependent variables. 

A related, but secondary, objective was the development 
of a system for unobtrusively measuring the information 
search behavior of administrators while these were occur- 
ring. This latter purpose was accomplished by developing a 
computer based information system with which the subjects 
interacted to obtain pertinent information for the decision 
problem. 



Methods 

The three stages of development for this research proj- 
ect were: 

1. The development and adaptation of materials and 
techniques to simulate the selection decision 
process. 

2. The conducting of an experiment in the simulated 
situation. 

3. The statistical analyses of the subjects’ responses 
to determine the effects of the manipulated vari- 
ables . 

The simulated situation consisted of two components: 

(a) the simulated situation in which the selection process 
takes place, and (b) the information system containing data 
on five fictitious teacher applicants. 

The simulation of these components offered several 
advantages: 

1. The control of certain variables ordinarily affect- 
ing selection decisions. 
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2. The systematic manipulation of the independent 
variables . 

3. The maintenance of administrative behavior that is 
similar to that elicited in a real situation. 

4. The ability to obtain measures of ongoing processes 
without interfering with those processes. 

The simulated materials used in the study were origi- 
nally developed in part by this experimenter for use in 
another study, 1 but were modified substantially to meet the 
requirements of this experiment. 

The subjects in this study consisted of 81 elementary 
principals selected randomly from the population of a three 
county area in the State of Washington. The subjects were 
then randomly assigned to the nine treatment conditions. 

The design of the study was a completely randomized 3x3 
fixed model treatment arrangement with measures on all five 
dependent variables. 

In general, the experimental task with which the sub- 
jects were faced was to consider five applicants for a fic- 
titious teaching position and make certain decisions regard- 
ing the suitability of each applicant for the position. 

This involved ranking the applicants and then indicating how 
certain he was his decision was ’'correct.” With the excep- 
tion of the certainty criterion, which was measured directly, 
measures on the other four dependent variables were obtained 
by recording and analyzing the search behavior of the sub- 
jects as they interacted with the computer based information 
system. 

An analysis of variance for the 3x3 factorial experi- 
ment was completed for all main and interaction effects of 
the two independent variables. There were six submeasures 
of the information selectivity criterion and two of the 
certainty measure; thus, there was a total of 11 ANOVAs com- 
puted. Newman-Keuls tests were used for all post analyses 
of treatment means . 

This research was based on the premise that, because 
the administrator making a selection decision is confronted 
by a myriad of information from a variety of sources, the 
manner in which he selects and processes this information 



*Dale L. Bolton, Variables Affecting Decision Making 
in th e Selection of Teachers , United States Office of Educa- 
tion, Bureau of Research, Final Report, Project No. 6-1349, 
August, 1968. 
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ultimately determines the quality of the decision made. 
Therefore,, unless one is willing to assume that search and 
processing behavior are random, the strategies which control 
them must be key components in any theory of decision mak- 
ing . 



Results 

Of the independent variables in the study, (a) cost and 
(b) risk, only cost affected the information processing of 
administrators in making teacher selection decisions, 
achieving statistical significance on eight of the 11 cri- 
terion measures. For the three levels of the cost treat- 
ment, the high cost group was the one which principally con- 
tributed to the variability on seven of the eight signifi- 
cant measures. The eighth was caused by the medium cost 
treatment group. 

The analyses of variance indicated cost had a main ef- 
fect on (a) five of the six selectivity submeasures, (b) 
the proportion of information utilized, (c) specificity of 
search pattern, and (d) time. Risk had no significant ef- 
fects and there were no significant interactions between 
cost and risk. 

The subjects in this study did evidence definite pat- 
terns of behavior on the four dependent variables postu- 
lated to be key components of information processing strate- 
gies. However, any conclusions regarding the stability of 
these patterns are highly tentative and (because of the 
weakness of the risk variable) based primarily on behavior 
resulting from manipulation of the cost variable. 

Implications 

Several direct implications arise from this research 
for practice in the selection of teachers: 

1. If principals and others involved in the selection 
of teachers are similar in nature to the subjects 
of this experiment, their decision processes will 
be influenced by the cost of information. 

2. If decisions can be made using far less informa- 
tion than is normally utilized — without a concomi- 
tant loss of quality — then substantial savings can 
be made by reducing the volume of information pre- 
sented to decision makers. 

The technique developed for analyzing information 
search processes utilizing a computer based information sys- 
tem holds considerable promise for use in the selection de- 
cision making process. Such a system affords: (a) control 
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over information format and quantity, (b) a record of in- 
formation search process of decision makers, and (c) a more 
efficient means of handling written information on appli- 
cants . 



Recommendations 

The principal recommendations resulting from this ex- 
periment are the following: 

1. School administrators should re-asses the nature 
and quantity of information inputs in the per- 
sonnel selection process. Considerable folklore 
has grown up around the nature and quantity of 
information which contributes significantly to the 
selection process. 

2. While the results of this study are not generaliz- 
able beyond the personnel selection process, ad- 
ministrators should examine experimentally and 
intuitively the concept of inf ormation value and 
its relationship to the decision process. 

3. The prevailing trends toward computer based aids 
to decision making suggest the viability of an in- 
formation retrieval system for use in making selec- 
tion decisions. The value of "screening out" un- 
wanted information and permitting decision makers 
to choose only items they consider relevant seems 
justified in terms of the high subjective certainty 
of subjects in this experiment — even those with a 
very small information pool to begin with. 



CHAPTER XI. THE PROBLEM 



Introduction 

When an administrator is faced with a decision, his 
initial behavior usually involves the seeking of relevant 
information in order to reduce his uncertainty about the 
decision and also lessen any risks that might be involved. 
The research reported here is based on the assumption that 
this behavior is not random, but rather that it is rela- 
tively specific and reflects a rational search process on 
the part of the decision maker. Further this implies the 
predictability of such behavior. 

Predictive models of information search behavior have 
generally followed the lines of Marschak's, 1 which pre- 
scribed a "rational" strategy for information search. How- 
ever, the results of previous experimental research in this 
field seem to indicate that — from a behavioral standpoint 
at least — individual information search strategies fre- 
quently, if not always, are at variance with most prescrip- 
tive statistical models that have been developed. 

It would seem that one means of developing an adequate 
model of the information search process would be to analyze 
the behavior of decision makers during that process and 
then attempt to classify this behavior into "strategies" of 
information search which are defined in behavioral terms. 

It is this general purpose that provides the rationale for 
this study. 

The focus of the research reported here is upon the 
behavior which takes place during pre-decisional informa- 
tion search and processing, and upon two determinants of 
that behavior, namely, (a) information cost, and (b) risk 
involved in the decision. This experiment involved the 
manipulation of the cost and risk variables in a controlled, 
simulated teacher selection situation in order to permit 
conclusions regarding their effect upon certain variables 
postulated tc be key components of pre-decisional strategies 
which decision makers apply — either explicitly or implicitly 
— in teacher selection. Since the information base under- 
lying a decision is a key determinant of decision quality, 2 



1 Jacob Marschak, "Towards an Economic Theory of Organi- 
zation and Information," Decision Processes , R. M. Thrall, 

C. H. Coombs, and R. L. Davis, editors (New York: John Wiley 
and Sons, Inc., 1954), pp. 200-205. 

2 Herbert A. Simon, Models of Man (New York: John Wiley 
and Sons, Inc., 1957), p. 241. 



this concern with pre-decisional strategies seems both 
valid and valuable, if one recognizes the need for improv- 
ing the quality of teacher selection decisions. 

Foundation of the Problem 

The prevailing concern of information and decision 
theory with the cost and value of information reflects the 
crucial nature of the role information plays in describing 
the environment to the decision maker. Depending upon the 
accuracy of this description, the decision will be similar 
ly effective or ineffective. Most of this concern has, 
however, focused only on the quantity and form of informa- 
tion as the primary index of information quality. The im- 
plied relationship would indicate a linear trend of in- 
creased decision quality as information quantity increased 
Yet substantial research indicates that this is not the 
case and that human information processing tends to break 
down under conditions of information overload. 3 

The classical economists' position is that informa- 
tion, like other inputs to the organization, should be ac- 
quired until marginal cost equals marginal revenue. Such 
a position is a tenuous one, however, for unlike manpower 
and material inputs — which yield measurable gain when in- 
cremental amounts are applied to a process or product — in- 
formation is inextricably related' to probabilistic notions 
of error and effectiveness. Information, then, tends to 
act less like an independent variable and more like a func 
tion itself, compared to the other organizational inputs. 4 
The relationship between cost of information and quantity 
is generally recognized and is more amenable to the tradi- 
tional marginal approach, for it is possible to assume a 
point of absolutely diminishing returns. Brenner summa- 
rized this relationship as follows: 

Over a range of quantity as an independent vari- 
able, we can expect to see value rise from zero 
worth to a peak, beyond which additional infor- 
mation only lessens the decision making ability 
of the manager, serves to confuse, and has less 
value than previous amounts. Less "surprise" 
attends additional increments of information as 



3 G. A. Miller, "The Magic Number Seven, Plus or Minus 
Two: Some Limits on Our Capacity for Processing Informa- 
tion," Psychological Review , 63:86, March, 1956. 

4 J. R. Brenner, The Cost and Value of Information , 
Technical Information Paper Z77-4370 (White Plains, New 
York: IBM Corporation, July 7, 1964), p. 8. 



well, and extrapolation takes over in the deci- 
sion process. 5 

Graphically, this function would resemble Figure 2.1. 



Dollars 




Figure 2.1 

The Relationship Between Amount of 
Information, Value, and Cost 

The implications of this discussion for the research 
reported here lies principally in the development of infor- 
mation search strategies by individual decision makers. Of 
particular concern is the variability which occurs in these 
strategies as a result of manipulation of the cost function, 
with an assumed concomitant effect upon information value. 
Likewise the operation of a risk variable on the components 
of the information strategies is of concern in view of the 
prevalence of risk elements in most decision situations. 

Rationale for the Research and Related Literature 

One of the key determinants of the quality of education 
is the nature of the teachers who implement the educational 
program. Quite obviously, then, one of the means most 
readily available to regulate the calibre of teachers with- 
in the school system is through the selection process and 
the placement of teachers within the system. In 1929, 
Cubberly indicated this when he stated that "... the most 
important place to guard the teaching service from deterio- 
ration is at the entrance gate." 6 Yet, in spite of this 



5 Ibid . , p. 10. 

6 Elwood P. Cubberly, Public School Administration 
(Boston: Houghton-Mif f lin Co., 1929), p. 304. 
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admonition, the process of teacher selection has not 
changed appreciably over the past 40 years in relation to 
the greatly increased sophistication of most other aspects 
of the educational process. 

Bolton summarized this well. He stated: 

The decision to select a teacher from among a 
number of applicants is the culmination of a 
series of preliminary decisions which consti- 
tute the selection process. So crucial is the 
selection of a teacher to che quality of the 
educational program that it seems obvious that 
this decision should be made only with the ut- 
most certainty regarding its utility. Yet, 
this is an anomaly of the selection process in 
education — and of selection in general — that 
such decisions are frequently intuitive and ar- 
bitrary. Contemporary administrative litera- 
ture contains many theories of widely diverging 
complexity and quality which purport to improve 
the selection process. However, the fact re- 
mains that very little empirical data exists to 
either substantiate or disprove these theories? 
and consequently, the process remains, in many 
respects at least, a highly subjective one. 7 

The reasons for the inadequacy of the teacher selec- 
tion process seem to be directly related to the lack of em- 
pirical knowledge about the decision making process in- 
volved. Descriptive knowledge of varying quality is plenti- 
ful, but empirical data about cause and effect relationships 
is practically nonexistent. The concerns which precipitated 
this study were the following: 

1. The failure of much research in decision making to 
consider the relationship between information and 
subsequent decisions. 

2. The nature of the theoretical models developed to 
describe the decision making process. 

3. Certain inadequacies of research designs in the 
experimental study of decision making. 



7 Dale L. Bolton, Variables Affecting Decision Making 
in the Selection of Teachers , United States Office of Edu- 
cation, Bureau of Research, Final Report, Project No. 6- 
1349, August, 1968, p. 8. 



